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Abstract 

Let z = Ylt^i x i/ a i where the Xi's are i.d.d centered with unit vari- 
ance gaussian random variables and (ai) ieN an increasing sequence such 
that $^i=i a i~ 2 < +00. We propose an exponential-integral representation 
theorem for the gaussian small ball probability P [z < e) when e J. 0. We 
start from a result by Meyer- Wolf, Zeitouni (1993) and Dembo, Meyer- 
Wolf, Zeitouni (1995) who computed this probability by means of series. 
We prove that P (z < e) belongs to a class of functions introduced by de 
Haan, well-known in extreme value theory, the class Gamma, for which an 
explicit exponential-integral representation is available. The converse im- 
plication holds under a mild additional assumption. Some applications are 
underlined in connection with statistical inference for random functions. 

Keywords : de Haan's Gamma class, small ball problems, regular variations, 
gaussian random elements. 

1 Introduction 

1.1 About non-shifted and shifted small ball problems 

Small ball problems could generally be stated the following way : consider a 
random variable X with values in a general normed space (E, |j-|j) (which may 
not be finite-dimensional) and estimate P (||X|| < e) for small values of e. This 
issue may be viewed as a counterpart of the large deviations or concentration 
problems (where P (\\X \\ > M) is studied for large M) and the term "small devi- 
ations" is sometimes encountered to name small ball problems. The core of the 
literature on small ball problems focuses on gaussian random variables. The 
nice monograph by Li and Shao (2001) is a complete state of the art, intro- 
ducing the main concepts and providing numerous references. Much attention 
has been given to the Brownian motion (when (E, ||-||) = (C(0.1) , H^)) or its 
relatives (fractional Bronwian motion, Bronwian sheet, etc). Authors also inves- 
tigated the case of stable random elements (see for instance Li, Linde (2004)). 
Another issue is related to the norm. Indeed in infinite dimensional spaces, 
norms or metrics arc not equivalent and this may influence the local behaviour 
ofP(||A|| <e). 

A more general question could be the shifted small ball probability : 

P (\\X - x \\ < e) (1) 
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for a fixed Xq. A stumbling stone arises from the shift xq. It turns out that, in 
general, computations cannot be carried out for any xq. Several works focus on 
expliciting the set of those xo for which the shifted small ball probability may be 
computed from the non-shifted one (when x$ = 0). We refer to Borell (1976) or 
Li and Linde (1993) for instance. A classical example stems from the situation 
where fx-x a -C Px where fx denotes the probability distribution induced by 
the random element A. The classical Cameron-Martin's theorem for Bronwian 
motion illustrates this case for instance. Then : 

P(p--s || <e)= / Px- X0 (dx)= [ f Xo (x)P x {dx) 

JB(0,e) JB(0,e) 

where f Xo = dPx-x a /dPx and B(0,e) stands for the ball centered at with 
radius e. When f Xo si regular enough in a neighborhood of zero : 

P(\\X-x \\<e)~f Xo (0)P(||A|| <e). 

About this fact see Proposition 2.1 in de Acosta (1983). In general the sharp- 
ness of existing results may vary depending on the triplet ((E, ||-||) ,P x ,xo) 
under consideration. Here Fx denotes the distribution of A. In fact there are 
only few spaces for which the local behaviour of P (\\X — xq\\ < e) is explicitely 
described. Quite often lower and upper bounds are computed so that : 

F(\\X-x \\ <e)^<p X0 (e) 

where ip Xo is known and / x g means here that the positive functions / and g 
satisfy : 

f 

limsup — < +co, 
o 9 



liminf — < +oo. 
9 

Sometimes only one of these bounds is accessible or needed. 

It is worth noting or recalling a few crucial features of small deviations 
techniques. The Laplace transform, as well as in large deviations problems, is 
a major tool when coupled with the saddlcpoint method. Small deviations are 
intimately connected with the entropy of the unit ball of the reproducing kernel 
Hilbert space associated with A, with the ^-approximation numbers of X (i.e. 
the rate of approximation of A by a finite dimensional random variable, see Li, 
Linde (1999) ) or to the degree of compactness of linear operators generating A 
(see Li, Linde (2004)). All these notions are clearly connected to the regularity 
of the process A, when A is a process. 

Applications of small ball probabilities are numerous : they appear when 
studying rates of convergence in the Law of the Iterated Logarithm (see Tala- 
grand (1992), Kuelbs, Li, Linde (1994)) or the rate of escape of the Brownian 
motion (see Erickson (1980)). They even surprisingly provide a sufficient condi- 
tion for the CLT (sec Lcdoux, Talagrand (1991), Theorem 10.13 p.289). How- 
ever small ball problems remained until nowadays a matter essentially reserved 
to probability theory. It turns out that this topic may be of major interest 
in a recent and soaring area of statistics : functional data modelling. The 
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situation may be summarized this way : since Lebesgue's density of an infinite- 
dimensional random X does not exist, all the inferential techniques based on 
the density cannot hold anymore. In this framework, the small ball probabilities 
appear as a natural counterpart and should be investigated with much care. We 
illustrate this fact by pointing out an elementary example in the next subsection 
below. 

First let us precise the I2 framework. Consider X a random variable defined 
the following way : 



where d{ is a real sequence such that J2t=L^/ a i < +°° an< ^ ( a i)i<t<fi * s a 
sequence of real independent and identically distributed random variables with 
AT (0,1) distribution. We assume throughout that the Oj's are arranged in a 
non-decreasing order. From Kolmogorov's 0—1 law it is straightforward to see 
that X exists as a ^-valued random element. The square norm of X is : 



The small ball problem consists here in estimating for different choices of 
the sequence (ai) igN the probability P (z < e) when e tends to zero. The latter 
probability is expected to depend on the o,'s. 

The inspection of the case E = I2 is motivated by the application to func- 
tional statistics mentioned in the paragraph above. Indeed random functions 
are often reconstructed by interpolation techniques, like splines or wavelets, 
in Hilbert spaces such as L 2 ([0,T]) or the Sobolev space VF m ' 2 ([0,T]). Then 
the random element X is valued in a separable Hilbert space H...&nd all these 
Hilbert spaces of functions are isometrically isomorphic to I2. Any gaussian 
random function X will be represented by its coordinates in accordance with 
([2|) and through the well-known Karhunen-Loeve decomposition on the basis 
of the eigenelements of its covariance operator (a" 1 , e^) where the e^'s are the 
eigenfunctions : 



The notations of this article are the same as those of Meyer- Wolf, Zeitouni 
(1993) and Dembo, Meyer-Wolf, Zeitouni (1995). These authors completely 
solved the I2 problem. For the sake of completeness and since the main theorems 
of this work heavily rely on their results I recall them. In both above-mentioned 
articles they proved that : 




(2) 



.2 




(3) 




lim e I(0) tp (0) P (z < e) = 1 /V2n 



(4) 
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where 9 e — 6 is defined by fi(9 £ ) = e with 



+00 



a, 2 + 20' 



(5) 



2<9 2 



^K 2 + 29) 2 ' 

2 — 1 ^ 1 ' 



(6) 



Without further assumption on the a^s P (z < e) cannot be made more explicit. 

The article is organized as follows. The next subsection develops some as- 
pects of theoretical statistics which motivate this approach on small ball prob- 
lems. Then a class of functions which appears in extremes value theory is 
introduced in the next section. This family of function turns out to be of major 
importance to assess our main results in section 3. The proofs are collected in 
the last part of the article. 



1.2 Small ball problems and some issues in statistical in- 
ference on curves. 

In statistics, local methods (like estimation of conditional expectation, regres- 
sion functions at a fixed point, etc) make it necessary to compute 

EA"(||Jf-a;o||//i) = J K {\\u - x \\ /h) dP x (u) 

where xo is a fixed point of the space, if is a kernel that is a mesurable pos- 
itive function with J K = 1 and ft. is a nonnegative number tending to (the 
bandwidth) . 

In a multivariate setting, when X is a R d valued random variable, elementary 
computations lead to : 

EK ( W X - x o\\ \ ^ Cdfx {xq) hd = fx {xq) . Vq1 [B (0> h)] (7) 



h 

in many situations. The exponent d may vary, depending on the support of the 
distribution of X. 

But Lebesgue's measure cannot be defined on a Banach space, for instance, 
and when X is a process, the density of X at x does not make sense anymore. 
A major issue is then to compute the preceding expectation without assuming 
that the density of X at x exists. Assuming that K has compact support (say 
[0, 1]) with K (1) > and integrable derivative we see from : 



J s 



K(s) = K(l)- / K'(s)ds 



and by Fubini's Theorem that : 
~h 



E/v ( [,X - =K(1)P(\\X -x \\ <h)- J A"(s)P(||X-a;o|| < ha) ds. 
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Denoting P(||X — xq|| < h) = F Xo (h) = F (h) for the sake of simplicity we 
finally get : 

EK ^ X fe ' To11 \ =F(h)K (f ) - £ K' (s) F (hs) ds. (8) 



From both last displays it is plain that the evaluation of EK 



IX— xn 



h 

strictly depends on the small ball probability F (h). When X is a random curve 
its behaviour at is crucial and determines the rate of convergence to zero of 
the above expectation -what statisticians arc truly interested in. 

In fact more intricate problems appear in statistical inference such as com- 
putations of truncated moments like : 



E [<p„ (X - x )] K 



\X-x a \ 
h 



where p is a nonnegative integer and ip p is a tensor of order p acting on the 
space supporting X. For example when p — 2, the local covariance operator 
may be defined by : 

E[(X-xo)0(X-xo)]K ^ X ~ Xo ^ . (9) 

Once again the local behaviour of the small ball probability is a major issue. We 
refer to Miiller and Yan (2001) for some statistical results on local moments for 
finite-dimensional random variables and to Mas (2008) for some related results 
dealing with Q and where random functions and small ball problems appear. 
Obviously the examples above are simplistic but shed some light on a new 
potential application of small deviations -out of the scope of pure probability 
theory- and which, to the author's knowledge, has not been pointed out until 
now. 

The reader should notice that formula (H|) does not seem to be suited to 
complete formula §§§ or even ([5]) since the estimate of the small ball probability 
is purely implicit. On the other hand rewriting display JS| leads to : 



EK I H* I =Fjh) 



Assume that F is regularly varying at zero with index d (which is usually true 
when X is finite dimensional) then by definition F (h) = Ch d l (h) where C is a 
constant, I is a slowly varying function at and F (hs) /F(h) —> s d when h — > 
which yields : 



EK l \\ X - X °\\ )r,Ch d l(h) 



K{1)- [ s d K'{s)ds 
Jo 



Unfortunately when X lies in the space I2, the most classical examples of F (h) 
are not reguarly varying as will be seen below. But however we notice for further 
purpose that the theory of regular variation is of some help in the important 
special case mentioned just above. 
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2 The class T 



This section is independent from the preceding. 

The theory of extremes is another well-known topic connecting probability 
theory, mathematical statistics and real analysis through regular variation and 
Karamata's theory. The foundations of Extreme theory may be illustrated by 
the famous Fisher-Tippett theorem (see Fisher, Tippet (1928) and Gnedenko 
(1943)). This classical result assesses that whenever U\,...,U n is an i.id. sam- 
ple of real random variables, M n = max{[/i, U n } belongs to the domain of 
attraction of G, where G has same type as one of the three distributions Gum- 
bel, Frechet and Weibull. The Gumbel law, also named double exponential 
distribution, with cumulative density function A (x) = cxp (— cxp (—x)) defines 
the so-called "domain of attraction of the third type". Laurens de Haan (1971) 
characterized the (cumulative) distribution functions of U such that M n belongs 
to the domain of attraction of A. We give this result below. 

Theorem (de Haan, 1971) : If F is the cumulative density function of 
a real random variable X which belongs to the domain of attraction of the third 
type (Gumbel) there exists a measuable function p : M — > R + , called the auxiliary 
function of F, such that : 



where F (s) = 1 — F (s) , x + = sup {x : F (x) < 1}. 

This property was intially introduced by de Haan's as a "Form of Regular 
Variation" (see the title of his article). This class of distribution function is 
referred to as de Haan's Gamma class in the book by Bingham, Goldie and 
Teugels (1987) and within this article. In the latter book the definition is slightly 
different from the one given above. Gamma-variation is defined at infinity and 
for non-decreasing functions which comes down to taking x + = +oo and taking 
exp (x) instead of exp (— x) in the display above. Surprisingly, in their book as 
well as in de Haan's article no examples of functions belonging to T is given. 
The cumulative density function of the gaussian distribution belongs to this 
class. with x + = +oo and p (s) ~ l/s. 

Since we focus on the local behaviour at zero of the cumulative density 
function of a real valued random variable we have to modifiy again slightly the 
definitions above. We introduce the class Tq and feature some of its properties 
below. We share most of our notations with Bingham, Goldie and Teugels 
(1987) which differ from those of de Haan. 

Let V + be a right-neighborhood of zero. 

Definition 1 The class Tq consists of those functions F : W. — > R + null over 
(—oo,0], non decreasing with F (0) = and right- continuous for which there 
exists a continuous non decreasing function p : V + — > R + , the auxiliary function 
of F, such that p (0) = and for all x G M, 



lim 



F{s + xp (s j) 
F(s) 



exp (—a;) 



lim 

slO+ 



F(s + xp{s)) 
F(s) 



exp (x) 



(10) 



The properties of the auxiliary function are crucial. 
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Proposition 1 From Definitional] above we deduce that : p (s) / s — > as s — ► 

and p is self-neglecting which means that : 

p(s + xp(s)) S ^Q 
P(s) 

locally uniformly in x G K. 

Remark 1 When the property in the proposition above does not hold locally 
uniformly but only pointwise the function is called Beurling slowly varying. As- 
suming that p is continuous in Definition [7] yields local uniformity and enables 
to consider a self-neglecting p. 

Let us also mention that Gaiffas (2005) proposed to model locally the den- 
sity of sparse data by gamma-varying functions. This is another statistical 
application for Tq. 

The class Tq is subject to an exponential-integral representation. In fact the 
following Theorem asserts that the local behaviour at of any F in To depends 
only on the auxiliary mapping p. 

Theorem 1 Let F belong to Tq with auxiliary function p then when s — ► : 

F (s) = C(l - e (s)) exp j- J -±^dt\ / p 2 (s) (11) 

with e (s) — > and the auxiliary function p is unique up to asymptotic equiva- 
lence and may be taken as J Q F (t) dt/F (s) . Besides 

( oo (A>1) 

F (As) jF (s) -> I 1 (A = 1) as s -> 0. (12) 
{ (A<1) 

Remark 2 The upper bound 1 in the integral in display ill]) is unimportant 
and may be replaced by any positive number. Then the constant C will change 
as well. 

The proof of Proposition!]] as well as Theorem[T]are inspired from the proofs 
of Lemma 3.10.1, Proposition 3.10.3 and Theorem 3.10.8 in Bingham et al (1987) 
and will be omitted. However the next Proposition seems to be new and specific 
from the class Tq. 

Proposition 2 Let F belong to Tq. Then for all integer p F^ (0) = where 
F^ denotes the derivative of order p of F. 

This means that functions from Tq are very flat in a neighborhood of zero. 
Proposition [5] may be intuitively explained. Let us start from the fact that the 
standard situation when X lies in M. d is illustrated by the right hand side of © . 
Then the d th derivative of this power function is always non-null. Consequently 
in an infinite dimensional space we can expect that all the derivatives at should 
be null. A more geometric way to understand this consists in considering the 
problem of the concentration of a probability measure. Let p be the measure 
associated with the random variable X . Once again starting from M. d and letting 
d increase -even if this approach is not really fair- we see that p must allocate a 
constant mass of 1 to a space whose dimension increases. Then p gets more and 
more diffuse, allowing fewer mass to balls and visiting rarely fixed points such 
as xq (and their neighborhoods), resulting in a very flat small ball probability. 
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3 Main results 



3.1 The representation theorems 

This article connects the two apparently distinct notions of probability of the 
two preceding sections : the class of gaussian small ball probabilities in l 2 and de 
Haan's Gamma class of functions. Both families of functions are defined by their 
local behaviour around 0. The starting point is purely empirical and is explicitcd 
in the Proposition and subsequent comments below. This Proposition, which 
is nothing but an application of formula ^ in Dembo, Meyer- Wolf, Zeitouni 
(1995), aims at showing to the reader the process that lead to infering the main 
results of this article. 

Lemma 1 (Dembo, Meyer-Wolf, Zeitouni (1995) and Mas (2008)) 

Take X as defined in $) with ai = i^/ 2 (/3 > 1) then : 

P (\\X\\ 2 < s) ~ Cxs- 1 '^-*) cxp (_C 2S -i/(/3-i)) . (13) 

where C\ and C2 are positive constants. By applying the formula of the previous 
authors, Mas (2008) proved that when ai = exp (a - i) , a > 

P (ll X l| 2<S )o^^ eX p(-S [10S(s)]2 )- (W) 

Remark 3 This lemma has several by-products. Simple algebra proves that 
both functions on the right hand side of US\) and \1J$ have all their derivatives 
vanishing at 0. We notice that when (3 tends to 1 the r.h.s. of il,'J\) is always 
flatter and that is for all (3 flatter than J_?^[ ) which in turn will always be 
flatter at than any polynomial function (like Cd,s d ). However we notice the 
the degree of flatness is directly connected with the rate of increase of the ai 's 
which quantifies, exactly like the l-numbers, the accuracy of a finite- dimensional 
approximation of X. 

The next Proposition is crucial and is a first step in connecting both preced- 
ing sections. 

Proposition 3 Both functions on the right hand side of U3\) and J_?^[ ) belong 
to the class Tq with respective auxiliary functions : 

p x ( s ) = M lS 1+1 /W-D (15) 
/92 (s) = -M 2 s/log(s) (16) 

where Mi and Mi are positive constants. 

Remark 4 It is easily seen that p\ and P2 match Proposition^ above. Besides 
letting (3 go to infinity we see that, in a way P2 may be viewed as a limit of p\ . 
In fact — l/log(s) echoes the degeneracy of 1/ (13—1). Remember that p(s) /s 
should tend to with s. 

Conversely turning to Theorem[T]and taking p (t) = t m (with m > 1) yields : 
i^Cr^exp^J^) (17) 
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and taking p(t) = 



—t/log(t) yields 



F( S )~c(^)\xp(-[log W ] 2 ) (18) 

Clearly displays and (JTTJ) on a one hand and (|14p and (1181) on the 
other hand are not equal but the dominating term (namely the exponential 
one) matches up to constants. The dissimilarity between the terms before the 
exponential will be developped and made clearer in the next subsection. 

The Proposition [3] leads to our main concern : is it possible to obtain a one 
to one representation, in a general framework, of the small ball probability of 
a gaussian random element in I2 -characterized by the sequence (ai) igN - by a 
function in Tq, depending solely on its auxiliary function p ? If so, what are the 
connections between p and the sequence (aj) igN ? The next theorem answers 
positively to this question and assesses that any small ball probabillity belongs 

to r . 

In all the sequel, the exponent —1 is strictly reserved to denoting the gener- 
alized inverse of a function / denoted Consequently in general / _1 ^ 1/f. 
This remark will be of much importance in the next section dedicated to the 
mathematical derivations. 

Theorem 2 Let z be defined by |3J) and set P (z < s) — F (s) then : 

FeT 

with auxiliary function : 

p=-L (19) 

where p was defined at display |[5|). 

It turns out that, surprisingly, a partial converse holds. The only additional 
assumption relates to the local properties of p and regular variation is assumed 
in order to apply the direct part of Karamata's theorem's within the proof. 

Theorem 3 Let F 6 Tq with auxiliary function p. Assume that p is regularly 
varying at zero and define p — and (p (t) = tp (t) then F is the small 

ball probability of a ^-valued gaussian random variable defined as above with, 
for some constant C : 

of = cv- 1 (i) 

Remark 5 Within Proposition [3] both auxiliary functions p\ and pi are regu- 
larly varying and the assumption of Theorem holds in this context. It is also 
possible to check - it takes some calculations however- that the relationship be- 
tween p and the sequence (ai) ieN defined through H19\) holds in the special cases 
examined in Lemma[]\ at displays HS\) and An interesting open question 

would consist in finding examples of auxiliary functions which are not regularly 
varying with positive index, whenever it is possible. 
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These theorems ensure that the exponential-integral representation (fTTj) holds 
for any small ball probability in 12- Comparing it with Q we can expect some 
simplifications for computational purposes. This issue is developped in the Re- 
mark E] below. But for the sake of completeness it is worth adressing a concern 
which may be misleading. Indeed we started from P (z < e) where z = \\X\\f 2 
and the properties of this function may differ from those of what may be intended 

as the "true" small ball probability P M|X||^ 2 < s 2 ^j . The next Proposition an- 
swers this question. 

Proposition 4 Let F S Tq with auxiliary function pf and define G : s — > 
F (s 2 ) . Then G belongs to Tq as well with auxiliary function pq defined by : 

PG (s) = y s Pf ( fi2 ) ■ 

Remark 6 Turning again to the statistical application mentioned at display 
and applying Lebesgue's dominated convergence theorem, it is plain that : 

EK ( l]X ~ X ° 11 ) ~K(l)F(h) 



since F (hs) / F (h) tends to zero for fixed s and h going to (see \12\l within 
Theorem]^. Let us focus on truncated or smoothed moments mentioned in (OJ) 
above and consider the weak versions of the tensors mentioned there : 

E (X - x , uf K ]X ~ X °^ or E (X, uf I {] \ X - Xo] \< h] . 

where u G Za- It turns out that the rate of decrease to zero in the display 
above depends critically on the the auxiliary function p which appears in our 
representation theorem and was computed in the case p = 2 by Mas (2008). 
This fact has serious consequences on the convergence of estimates in some 
statistical models (see Berlinet, Elamine, Mas (2008)). 

3.2 Complementing the representation of the de Haan's 
Gamma class. 

As mentioned earlier, just below display (fT5|) we noted that the representations 
obtained from Dembo, Meyer- Wolf, Zeitouni (1995) and those from the class Tq 
do not match, due to a multiplicative term. 

If we turn again to Definition [T] and pick a F in Tq it is plain to see that 
any function <j>F where (j>(x + tp (x)) /<j>{x) — > 1 when x — > belongs to Tq with 
exactly the same auxiliary function p. This is a drawback of the representation 
proposed above. But the reader also noticed that the previous results assess that 
the function p is not unique and may be replaced by any p such that p ~ p at 
zero (see Theorem[T]just below display (fTTj) ). We prove now that these facts are 
intimately connected and that changing p to p finally comes down to changing 
the function <f> above. 

We start with a definition which seems to be new. 

Definition 2 Let p be a self-neglecting function. A function <fi is called p-self- 
neglecting if : 

<j)(x + tp (x)) _^ ^ 
cf> (x) x^O 
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We propose a representation theorem for p-self- neglecting functions. This 
theorem will be useful in the sequel. 

Theorem 4 Let p be self-neglecting at which does not vanish in a neighbor- 
hood of Q. A function <p is p-self-neglecting iff : 



where c(u) — ► c e ]0, +00) and e (it) — > w/ien u — * and e has the same 
regularity as p. 

This theorem generalizes the representation Theorem 2.11.3 for self-neglecting 
functions p. 121 in Bingham et al. (1987) initially due to Bloom (1976). If one 
take 4> = p the representation above coincides with the one announced in this 
theorem. 

The next result shows how an asymptotically invariant change of the auxil- 
iary function p influences the overall expression of a function in To through the 
previous theorem. 

Theorem 5 Let us take a function F in Tq with auxiliary function p with 
representation : 



Then changing F into <pF = F where <f> is a p-self neglecting function belongs 
again to Tq. The auxiliary function of F isp = pj (1 — e) where e is the function 
defined in the Theorem above, hence p ~ p at zero. 

The proof of this last theorem is straightforward with Theorem |4] at hand 
and omitted. 

Remark 7 The results of this section could be rephrased this way : the equiva- 
lent class of self-neglecting functions induced by the relationship p\ ~o Pi creates 
an equivalence class for functions in Tq through the relationship A defined for 
all F and G in Tq by 



And our results are rather a representation for functions in To\A. Neverthless 
from a more practical viewpoint these considerations vanish when considering 
the logarithm of the small ball probability in the following sense : if F (resp. G) 
belongs to Tq with auxiliary function p\ (resp. P2) and p\ ^0 P2 then logF ~o 
logG. 

3.3 Conclusion 

The main results of this article are rather formal. They identify gaussian small 
ball probabilities in I2 with a class of rapidly varying functions involved in ex- 
treme value theory and whose derivatives at all orders vanish at zero. This 





FAG — is p — self-neglecting 
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representation was obtained through previous works especially the seminal for- 
mula But we hope and guess that this new formulation will be more con- 
venient for modelizing the small ball probabilities with some applied -especially 
statistical- purposes in mind. However many questions arise, most of them with 
rather theoretic aspects. It seems that the gaussian framework could be ex- 
tended when the assumptions Al — 4 p. 279 of Dembo et al. (1995) hold. The 
generalization to random elements with values in l p or in more general Banach 
spaces is an open and certainly intricate matter since the starting fomulas @ 
and followings seem to be intimately suited to the space ?2- 

A more promising track could be to explore the links between the auxiliary 
function p, which inherits all the seminal information on the regularity of X, 
with the metric entropy of the unit ball of the reproducing kernel Hilbert space 
of X as explored in Li, Linde (1999) or with the degree of compactness of the 
operator v in Li, Linde (2004) for instance, the latter operator v being obviously 
close to the covariance operator of X hence in connection with the a^s of this 
article. 

The connections between regular variations and small ball probabilities have 
been known since de Bruin in 1959, and his theorem on Laplace transfoms (see 
Theorem 4.12.9 in Bingham et al. (1987)). This work confirms that both 
Tauberian and extreme value theory may provide tools complementing large 
deviations techniques to derive new results in this area. This deserves certainly 
more attention. 

4 Proofs 

We start with the proof of Proposition [TJ 
Proof of Proposition [TJ : 

Suppose that p(s) / s does not tend to zero when s does. Then we may pick 
an e > such that for infinitely many s& J, when k f +oo, p{sk) /sfe > £■ 
Now fix x < — e _1 then + xp(sk) < and F (sk + xp(sk)) = for all k 
and F (s* + xp (a*)) JF (sk) cannot converge to exp (x). The second part of the 
proof, namely ensuring the p is self-neglecting, follows the lines of the proof of 
Proposition 3.10.6 in Bingham et al. (1987). ■ 

Proof of Proposition [2] : Suppose that for some p F& (0) ^ and 

take p* = inf {peN: (0) ^ 0}. It is plain that F^"> (0) > since F is 
positive. Then we should consider two cases. First if FCp*) (0) = c < +oo then 
F (s) ~ cs p ' . Taking : 

F(s + p(s)) _ F{s + p(s)) S p" {s + p(s)f 
F(s) ~ (s + p( s )) p ' F(s) S p* 

we see that the left hand side of the display above tends to exp (1) whereas the 
right hand side tends to 1. 

Second if F^*) (0) = +oo we clearly have F (s) / s v — > +oo when s — > 0. 
Take e such that 1/s > p* + 2. Since p' (0) = and p is positive we may pick 
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an so such that sup 0<u<s p' (u) < e. From (fTTj) we get 

F(s) C f f 1 1 , 1 C f Z" 1 1 , 

' < m o t \ exp - / — -dt } < —— - exp - / — 



s p - s y( s ) **i y s j-^( s ) "\ j s P {t) 
c r r i , 

< -^XTT-T exp ^ - / —-dt 



where we assume that s < sq. Then we have 

exp {- r w)"'} - ™ p { - r iMA) *} s exp {-; r tw"' 

= exp j-lnp(s)--lnp (s ) 



At last 



^ (S) <C"[p{s)Y- p *- 2 



s" 

which contradicts the fact that F (s) / s p — > +oo. ■ 

Before turning to the proof of Theorem [5] we go on with a lemma. Remind 
that the function t/j was defined just below display ([5]). 

Lemma 2 Function ip (resp. ipop^ 1 ) is increasing (resp. decreasing), and 



Ip' (u) _ 1 ^ i=1 (a?+2u) 



+oo 1 



(20) 



{a 2 i +2uf 



Besides, 



when 9 goes to +oo. 



9p{9)^+oo (21) 



Proof : 

Display (|2"U)) is obtained by straightforward calculations, we leave it to the 
reader. It implies that ip is increasing and that ip o pr x is decreasing since p is. 
We prove (|2"Tj) . We have : 

+x ft N(e) ft 

^> + ~ ^ a? + 25 

where N (9) = sup {i : af < 6} . Then 

0/x(0)>^V(0). 

Obviously N (9) goes to infinity when 9 does because the aj's do and are ar- 
ranged in a non-decreasing order. ■ 

Proof of Theorem [2] : 
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From Definition [T] and (H|) we see that Theorem [2] holds whenever for all 
x6K: 

s ™ r/> (p" 1 (s + a;p(s)))exp(/(^- 1 (s + xp(s)))) expa; - 
We focus on proving that : 

lim o / ( -w I 6XP ( 7 ( S )) - 1 ( S + X P ^ ~ x ) =1 - 
s->0 lp [p L (s + xp{s))) 

The two next lemmas are dedicated to showing that, in the above display the 
fraction as well as the exponential both tend to 1 when s goes to zero and p is 
chosen as in the Theorem. 

Lemma 3 Take p(s) = l/p -1 (s) , then : 

lim exp (I (p -1 (s)) - I (p -1 (s + xp (s))) - x) = 1. 



Remark 8 Obviously p has at least two (we do not need more) continuous 
derivatives on a neighborhood of infinity (here ]l,+oo) for instance). It is also 
strightforward to see that p, which is strictly decreasing on ]l,+oo), is also a 
C 1 diffeomorphism on this set. Clearly lim s ^o p (s) = but from \21\l it is plain 
that p (s) / s also tends to zero when s does which implies that p' (0) = 0. Indeed 
proving that p(s) /s tends to zero comes down to proving that Op (9) — ► +oo. 

Proof of the Lemma : 

Taylor's formula gives : 

I (m- 1 (.))-/ (p^ (s + xp (.))) = -xp (s) ^H+^p 2 (•) [I (p- 1 )]" (c s , x ) 

^ ^ S (22) 
where c S}X — c lies somewhere in [s, s + xp (s)} if x > and in [s + xp (s) , x] if 
x < 0. From © we see that : 



1 + °° / 9f)\ 

/'(0) = 5 $>g 1 + ^ )~op(0) 



2 

i=l 

= p{6)-p{6)-6p!{6) 
= -Op' (9) 

which immediately yields ^77^tt^] = p 1 (s) . Hence (j2"2"j) may be rewritten : 

/ (p- 1 (a)) - / (p" 1 (* + (*))) = ( S ) p- 1 ( S ) + y p 2 ( S ) [/ (p- 1 )] " (c s ) 
Choosing p( ) = l/p -1 (•) we have : 

I (p- 1 («)) - / (p- 1 ( S + .xp ( S ))) - x = y p 2 (,s) [/ (p- 1 )] " (c) 
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and the Lemma will be proved if we get 

limp 2 (a) [7( M - 1 )]"( C ) = 0. 



(23) 



But for all t 



dt 

p) { ) P 2 (ty 



dt 



(t) 



Hence 



p (s) [I (»-')]" (c) = p 2 ( S ) 



P'(c) 
P 2 (c) ' 



(24) 



We first show that p 2 (s) / p 2 (c) is bounded above. We may always write c = 
s + t x (s) p (s) where —x < t x (s) < x for all s. Taylor's formula yields 

p(s + t x (a) p («)) = p (a) + t x (a) p (a) p' (d) = p (a) (1 + t x (s) p' (d)) 

where d lies between s and s + t x (s) p (s) . Hence 

p(f) 1 < 1 

p(c) l + t K (s)p'(d) - 1- \x\p'{d) 

The continuity of p' at and its nullity at (see Remark [H]) implies on a one 
hand that the display above is bounded above for fixed x and a (hence d) going 
to zero and also that (|24|) holds as well as (|23|) . This finishes the proof of the 
Lemma. ■ 



Lemma 4 When p(s) = 1/p 1 (s) , 

^(p-'is)) 



I™ -0 (p- 1 (s + Xp(s))) 

Proof : 

Assume that x > 0. We will prove that : 

-0 (p^ 1 (f + xp(s))) _ ^ 
s ™ V(M _1 (s)) 
Once again Taylor's formula leads to : 

^(p-Hs + xpjs))) (^pI'(c') 

^(p-i(.s)) i + xp[s) ^Oi-Hs)) 

where c* G [s, s + xp (s)] since x > 0. So we focus on proving that 

(Vop- 1 )'^*) 



limp(s) 



^(p-l(s)) 
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where 
and 



We set 



p(s)p(c*) 



Ml (s) = 
Mf (*) = 
Mi ( S ) = 



fx' o fx 1 (c*) 

^(m- x (s)) ' 



^(cjVC/i- 1 ^))' 

We keep in mind that x > is fixed and s goes to zero, and prove that : 

Ml (s) -> 
sup{Mf (s),Mf ( S )}<1. 



We start with 



M|( S ) = 



(^o/i' 1 ) (c*) 

A.' 1 (c») (V/ o A.' 1 ) (c*) 
V(M- X (c*)) 



where 9* = 9* (s) = ii 1 (c*) and clearly 0* — * +oo when s goes to zero. We 
prove that for large 9*, 9*ip' (9*) /ip (9*) is bounded. From (I20| it is plain that : 



E+oc 



oo a,- 



(a?+2e*)' 3 



< sup ■ 



< 1 



(25) 



for all i and 9* . 

We turn to Mf (s) . Since ip o p,^ 1 is decreasing and c* > s , Mf (s) < 1. 
At last we deal with Mf (s) : 



Mf ( a ) 



p(s)p(c*) 



p/ Oil 1 ( c *) 



p'(c*)p(s)p(c*) 



P 2 (c*) 



= |p' (Ol 



p(f) 

p(c*) 



since p (•) = 1 (•) • Now as p is increasing 

0<44<1 
" p{c*) ~ 
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and since p' is continuous at with p' (0) = we have 

lim Mf (s) = 

hence 

hm p (s) — —; — = 

and Lemma is proved when n > 0. 

Now when x < 0, all the steps carried out above lead to the same result 
when starting from : 

hm —, t-. ----- = 1 

s^o ip (p- L (s + xp(s))) 

instead of dealing with ^^(^-"T^) ~ ■ I n f ac t everything holds just replacing 
s + xp (s) (with x > 0) by s and s by s + xp (s) (with x < 0). ■ 

Now we turn to the proof of the converse part, Theorem [31 It takes two 
steps. 

First we should make sure that when af = ip^ 1 (i) , 

4r < +°° 
^ of 

which will ensure that the random element defined by X = (—,—,...) is well- 
defined. Then we will prove that when X is defined this way its small ball 
probability is F with auxiliary function p. 



Lemma 5 When af = <p 1 (i) , ^2 ^ < +oo- 

Proof : It is easily seen that ip^ 1 is non decreasing in a neighborhood of 
+oo. Indeed it suffices to prove that tp is, which may be deduced from its 
definition by studying its derivative. By the way one may also see that tp is 
concave. Now since <~p~ x is non decreasing it is enough to prove that : 

+oc dx 
tp {x) 

where the notation above means " the improper integral converges at infinity" . 
Set u = ip^ 1 (x) above then we should examine : 

u 

Integrating by part this comes down to ensuring first that y ^ tends to a finite 

limit as A tends to infinity which is plain with v ^ = p, (A) — > and second 
investigating 
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Once again let us change the variable and set t — (j^ (u). The integral above 
becomes : 

tp> (t) 



, . dt. 
Jo P(t) 

Now we are in a position to apply Karamata's theorem to p' : since p is regularly 
varying at with index d > 1 (since p' (0) = 0), and monotone in a right 
neighborhood of zero, p' is also regularly varying with index > (see Theorem 
1.732.b p. 39 in Bingham et al.(1987)). Then we can apply the direct part of 
Karamata's Theorem to p' (see ibid. Theorem 1.5.11 (i) p. 28 where the limit 
should be taken here at zero) and 

hm r ,Y < +°° 
t-tO p(t) 

which ensures that the integral above converges and finally that Y] -i^ < +oo. 
this completes the proof of Lemma [SJ ■ 

Proof of Theorem p] : 

Take X = C^, f|, ...J where the eij's were defined at Lemma (J5J) and where 
the Xi's are i.i.d. ./V (0, 1). By Theorem[2]we know that the small ball probability 
of X, denoted F is Gamma- varying at and by (J4j) that : 

lim e I(e) ip{6)F(e) = 1/v^tt. 

For the sake of notational simpicity we identify F with the function e — > 
ip o 6 (e) x e Io9lye \ In order to complete the proof of the Theorem we just have 
to check that the auxiliary function of F is, up to asymptotic equivalence, p. 
We follow Corollary 3.10.5 (b) p. 177 in Bingham et al. (1987) and claim that 
it is enough to prove that : 

lim— m >1. 



*° (F)\s)p(e) 



It takes basic algebra to get : 

F(e) -(p'o6)(e) 



1 1 



1 (e) i _ 4>'°e(c) 



ipo8(e) 0(e)(/i'o8)(e) 



We are going to show that : 

ip' o 6 (e) 1 



ip o 6 (e) (e) (jjl> o 0) (e) 
when e — > which comes down to proving : 

%p'{0) 1 0ip'(0) 1 



ip (0) 0pl (0) ip (0) 6»V (f ) 
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when 9 — > +00. From display (125[) within Lemma [3] we know that 

6ip' (9) 



sup 

e 

and finally we focus on 



^ (6) 



< 1 



+00 / /i \ 2 N 

l»V«»|=2W ') >2J2 



1=1 - - ' 1=1 x 1 

where Ng = max {i : a 2 < 9} and \9 2 p' (9)\ > %N . At last since Ng — ► +00 
when does we get 

hm^^l 
~° (F) (e) 

but /i o 9 (e) = e hence = = 1/p which finishes the proof of Theorem[31 ■ 
Proof of Proposition [4] : 

First we prove that G belongs to To. It suffices to show that for a well-chosen 

Pa, 

G{s + xp G (s)) 

GW eXP(x) 

when s tends to 0. But 

G(s + xp G (a)) _ F (s 2 + a 2 p| (s) + 2xs/9 G (a)) F (a 2 + 2xsp G (a)) 
G(a) ~ F(a 2 ) ~ F (a 2 ) 

since p 2 G (a) = o (spa (s)) and by applying the counterpart of Proposition 3.10.2 
in Bingham et al. (1987) in the case of To. By the way this property of uniform 
convergence in (flQ|) clearly holds for To as well and its proof is omitted (Dini's 
theorem may be applied since F as monotone). Now setting 2spc (s) = pf (s 2 ) 
yields 

G(s + xp G (a)) F(s 2 +x PF (a 2 )) 
Qjgj 

It is simple to check that pc (s) /a — * and that pa (s) is self-neglecting. ■ 

Finally we turn to the proof of Theorem [5] and start with a Lemma. This 
Lemma, its proof and the subsequent proof of the theorem adapt the derivation 
of Lemma 2.11.2 and Theorem 2.11.3 of Bingham et al. (1987). 

Lemma 6 Let p be self-neglecting at 0. For xq > sufficiently small the se- 
quence x n — x n -i — p (x n -i) tends to 0. 



Proof : First note that the sequence x n is decreasing since p > and 
notice from the properties of self-neglecting functions (namely p (a) /a — > 
when a — > 0) that for a sufficently small xq > 0, x n > for all n. The limit of 
x n exists, is denoted I. Suppose that I > 0. Then p (I) > and since p is a non 
decreasing function p (xk) > p (I) for all k. At last 

n-i 

x„ = x„_i - p (at n _i) = x - p (a:*) 

fc=0 

< Xq — np (I) . 
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Letting n go to infinity x n goes to — oo which contradicts x n > hence the 
Lemma. ■ 

Proof of Theorem |4j 

Let x n be as in the preceding Lemma. Let p be a C°° probability density 
on [0, 1] and set for x n +\ < u < x n 



In <j> {x n+ i) - In <f> (x n ) ( x n -u 
e (u) = p i 



Xn X n -\-l 



Xn Xn+1 



p(u) 



The proof takes three steps. 

We prove first that for all x n , 4>(x n ) = exp ^j^jduj . In fact we may 
always define e(u), xq < u < 1 such that 4>(xq) — exp ( j^du^j 
assume that 4> (xk) = exp ( jj^du) for k = 0, 1, .., n. We have : 



Then 



1 ejv) 

x n + 1 P( U ) 



du = 



1 P( U ) dU + Jx n P(U) 



-du 



ln<j)(x n ) 



ln^>(a; n+ i) - ln^(i„) 



X n +1 





du 



Xn 

= ln0(as„) - (bx(f)(x n+ i) - ln<f>(x n )) J p(t)dt 
= \n<f>(x n+ i) 

Second we prove that for x n +i < x < x n lim^^o 4> i x ) /4>{ x n) — L We note 
that x — x n — X x p (x n ) where X x 6 [0, 1] hence 

j. <HPn ~ Kp(x n )) _ 1 
x^O 4>(x n ) 

uniformly with respect to X x € [0, 1]. 

The third and last step is devoted to proving that \e (u)\ — > when u — > 0. 
Indeed for all x n +i < u < x n , 



\e(u)\<\ P \ c 

We focus on 

ln^>(x„+i) - ]n<f>(x n ) 



\n(/)(xn+i) - hx<f>{x n ) 



p(u) 



p(x n ) 4>{x n +l) 

p{x n -\ u p{x n )) (j>{x n ) 
m ■ 



p(Xn) 



4>(x n - p{x n )) 



Just like above p(x n — X u p(x n )) /p(x n ) — ► 1 since p is self-neglecting. Finally 
by the definition of 4> we get 



In- 



4> (x n ) 



4>(x n - p{x n )) 
which finishes the proof of the Theorem. ■ 







20 



References 

[1] de Acosta A. (1983) : Small deviations in the functional central limit 
theorem with applications to functional laws of the iterated logarithm, Ann. 
Probab., 11, 78-101. 

[2] Berlinet A., Elamine A., Mas A. (2008) : Local linear regression for 
functional data, submitted, |http:/ / arxiv.org /abs/07 10. 5218vl| 

[3] Bingham N.H., Goldie CM. and Teugels J.L. (1987) : Regular Varia- 
tions. Encyclopedia of Mathematics and Its Applications, Cambridge Uni- 
versity Press. 

[4] Bloom S. (1976) : A characterization of B-slowly varying functions, Proc. 
Amer. Math. Soc, 54, 243-250. 

[5] Borell C. (1976) : Gaussian Radon measures on locally convex spaces, 
Math. Scand., 38, 265-285. 

[6] Dembo A., Meyer- Wolf E. and Zeitouni O. (1995) : Exact behavior 
of gaussian semi-norms, Statist. Probab. Lett., 23, 275-280. 

[7] ERICKSON K. (1980) : Rates of escape of infinite-dimensional Brownian 
motion, Ann. Probab., 8, 325-338. 

[8] Fisher R.A. and Tippett L.H.C. (1928) : Limiting forms of the fre- 
quency distribution of the largest or smaller member of a sample, Proceed- 
ings of the Cambridge Philosophical Society. 24, 180-190. 

[9] Gaiffas S. (2005) : Convergence rates for pointwise curve estimation with 
a degenerate design, Math. Methods Statist., 14, 1-27. 

[10] Gnedenko B.V.(1943) : Sur la distribution limite du terme maximum 
d'une serie aleatoire, Ann. of Math., 44, 423-453. 

[11] DE Haan L. (1971) : A form of regular variation and its application to the 
domain of attraction of the double exponential distribution, Z. Wahrschein- 
lichkeitstheorie. verw. Geb., 17, 241-258. 

[12] DE Haan L. (1974) : Equivalence classes of regularly varying functions, 
Stochastic Process. Appl, 2, 243-259. 

[13] Kuelbs J., Li W.V. and Talagrand M. (1994) : Lim inf results for 
Gaussian samples and Chung's functional LIL, Ann. Probab., 22, 1879- 
1903. 

[14] Ledoux M. and Talagrand M. (1991) : Probability in Banach Spaces. 
Isoperimetry and Processes, Ergebnisse der Mathematik und ihrer Gren- 
zgebiete, 23, Springer- Verlag. 

[15] Li W.V. and Linde W. (1993) : Small ball problems for non centered 
gaussian measures, Probab. Math. Statist., 14, 231-251. 

[16] Li W.V. and Linde W. (1999) : Approximation, metric entropy and small 
ball estimates for Gaussian measures. Ann. Probab., 27, 1556-1578. 



21 



[17] Li W.V. and Linde W. (2004) : Small deviations of stable processes via 
metric entropy, J. Theoret. Probab., 17, 261-284. 



[18] Li, W.V. and Shao Q.-M. (2001) : Gaussian processes : Inequalities, 
small ball probabilities and applications, In Rao and Shanbhag (eds.), 
Handbook of Statistics, 19, Elsevier, New- York, 533-597. 

[19] Mas A. (2008) : Local functional principal component analysis, Complex 
Analysis and Operator Theory, 2, 135-167. 

[20] Meyer- Wolf E. and Zeitouni O (1993) : The probability of small gaus- 
sian ellipsoids, Ann. Probab., 21, 14-24. 

[21] Muller H.G. and Yan X. (2001) : On local moments, J. Multivariate 
Anal, 76, 90-109. 

[22] Talagrand M. (1992) : On the rate of convergence in Strassen's LIL, 
Progr. Probab., Birkhauser, Boston, 339-351. 



22 



